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(54) Video recording apparatus and method, and centralized monitoring recording system 



(57) Disclosed is a video recording apparatus capa- 
ble of performing long-recording at higher density and 
certainly associating the video data with additional data. 
Video images from a plurality of video cameras 101 are 
captured by a multiplexer 103 while sequentially being 
switched.. A frame compositing unit 1 forms reduced 
video images by reducing the captured video images 
and generates a composite video image by displaying 
the reduced video images on divided parts. A CPU 3 
generates additional data related to the reduced video 
image on each divided part and records the composite 



video image arxj additional data onto the same video 
cassette tape 7 while maintaining the correspondence 
t>etween each reduced video image and additional data. 
By recording video images from the plurality of video 
cameras at higher density, long-recording can be real- 
ized. By using the additional data, a desired reduced 
video image can be retrieved from the recorded com- 
posite video image and the retrieved reduced video 
image can be analyzed. 
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Description 

[0001] The present invention relates to a video 
recording apparatus and method for recording a plural- 
ity of video images supplied and a centralized monitor- 
ing recording system capat>le of collecting video images 
to be monitored from a plurality of installed monitoring 
video cameras, recording them onto a recording 
medium such as a video tape, and monitoring them. 
[0002] In recent years, in the service trade such as 
a bank in which an automatic teller machine (ATM) is 
installed, a retail shop which is open until late at night, or 
a hotel, a monitoring video camera is widely installed for 
security. In each ofJheJadlities. usually, a plurality of 
positions are to be monitored so that a plurality of mon- 
itoring video cameras have to be installed. Since it is not 
realistic that a person always monitors video images 
captured by the monitoring video cameras, usually, the 
captured video images are recorded by a video cassette 
recorder (VCR) or the like. When something happens, 
the recorded video inriages^can be^feproduced^arid' 
watched. 

[0003]~ The VCR is. however, usually expensive and 
the cost of installing VCR for the plurality of monitoring 
video cameras increases. Consequently, the video 
images from the plurality of monitoring video cameras 
are switched in a time division manner and captured in 
one system and the captured video images are 
recorded by one VCR. In this case, when the video 
_inrvages_from the piuralityjof_,monitoring.video_cameras. 
are recorded as they are sequentially on the same video 
tape, since the length of the video tape is iimrted. long- 
time continues recording cannot be performed. 
[0004] For example, as disclosed in Japanese 
Unexamined Patent Application No. 10-108163. a 
method of reducing video images from a plurality of 
monitoring video cameras and compositing the'reduced 
video images in conr^ination to form one composite 
video image has been proposed. According to the 
method, the video images from the plurality of video 
cameras can be recorded at high density on a video 
tape having a limited length, so that recording of longer 

time can be realized. 

[0005] One of the objects of the monitoring video 
system as described above is, when some problem 
occurs, to check nrK>nitoring video images recorded on 
the video tape later to analyze the status and cause of 
the problem. Consequently additional information such 
as recording date and time Is recorded in association 
with recorded data of each frame or field. For example, 
in a conventional analog recording system, recording is 
performed so that additional data is inserted in a vertical 
blanking period for an image of each field. Since only 
one video image is included in one field, the corre- 
spondence between the video image and the additional 
data is clear, 

[0006] In a system of reducing a plurality of video 
images and combining them to thereby form one com- 



posite video image as described above, however, when 
the composite image in a frame or field and the addi- , 
tional data are associated with each other in a manner 
similar to the conventional one. from the additional data, 

5 the corresponding reduced video image in the compos- 
ite video image cannot be specified. There is conse- 
quently a problem such that, when some trouk^e occurs 
and data on the video tape is analyzed later, the addi- 
tional data cannot be effectively used. 

10 [0007] The invention has been achieved in consid- 
eration of the problem and its object, in at least pre- 
ferred embodiments, is to provide a video recording 
apparatus, method and a centralized monitoring record- 
ing system capable of recording a video image certainly 

75 in association with additional data while performing 
higher-density video recording. 

[0008] A video recording apparatus of the invention 
comprises: composite video irrage generating means 
for generating reduced video images by reducing each 

20 of a plurality of video images supplied and generating a 
^ bom"pbsitie'^id6b^ima^ge~by^c6n^^ 

reduced video images; additional information generat- 
ing means for generating additional information for each 
of supplied video images: and recording means for 

25 recording the composite video image and the additional 
information onto a predetermined recording medium in 
such a manner of maintaining the correspondence 
between each of the reduced video images included in 
the corrposite video image and each additional informa- 

, 30 tion. _ , 

[0009] A centralized monitoring recording system of 
the invention comprises: a plurality of video cameras for 
capturing and outputting video images: composite video 
image generating means for generating reduced video 

35 images by reducing each of a plurality of video images 
supplied from the video cameras and generating a com- 
posite video image by compositing the generated 
reduced video images; additional information generat- 
ing means for generating additional information for each 

40 of the supplied of video images; and recording means 
for recording the composite video image and the addi- 
tional information onto a predetermined recording 

medium in such a manner of maintaining the corre- 

spondence between each of the reduced video images 

45 included in the composite video image and each a ddi- 
tional information can be maintained. The "system" 
denotes a k>gical collection of a plurality of apparatuses 
and it doesn't matter whether apparatuses of respective 
configurations are in the same casing or not. 

so [0010] A video recording method of the invention 
comprises: a step of generating reduced video images 
by reducing each of a plurality of video images supplied 
arKl generating a composite video image by composit- 
ing the generated reduced video images; a step of 

55 obtaining additional information for each of the supplied 
video images; and a step of recording the composite 
video image and the additional information onto a pre- 
determined recording medium in such a manner of 
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maintaining the con^espondence between each of the 
reduced video images included in the composite video 
image and each additional information. 
[0011] According to the video recording apparatus 
or video recording method of at least preferred embodi- s 
ments of the invention, each of the supplied video 
images is reduced to thereby generate a reduced video 
image. The generated reduced video images are com- 
posited to a composite video image. On the other hand, 
additional information is generated or obtained for each io 
of the supplied video images. The composite video 
image and the additional information are recorded on 
the recording medium in such a manner that the corre- 
spondence between each of the reduced video images 
included in the composite video image and each of the is 
additional information can be maintained. 
[0012] In the centralized monitoring recording sys- 
tem of at least preferred embodiments of the invention, 
each of the video images supplied from the video cam- 
eras is reduced to thereby generate a reduced video 20 
image. The generated reduced video images are com- 
posited to a composite video image. On the other hand, 
additional information is generated for each of the sup- 
plied video images. The composite video image and the 
additional information are recorded on the recording 25 
medium in such a manner that the correspondence 
between each of the reduced video images included in 
the composite video image and each of the additional 
information can bejnaintained. _ ^ 
[001 3] ' In The \^deo recording appaTaSis, video" so 
recording method, or centralized monitoring recording 
system of at least preferred embodiments of the inven- 
tion, the video images from the video supply sources 
(including the video cameras) can be intermittently cap- 
tured by switching the video images in the time division 3S 
manner 

[0014] In the video recording apparatus, video 
recording method, or centralized monitoring recording 
system, it is preferable that the additional information 
includes at least one of supply source information 40 
(including camera identification information) indicative 
of each of supply sources of the video images, record- 
ing date and time information indicative of date and time 
on/at which each of the video images is recorded, frame 
division configuration information indicative of the 4S 
arrangement and the maximum number of the reduced 
video images in the conrposite video image* recording 
apparatus identification information for identifying the 
video recording apparatus used for recording, and con- 
tents information regarding the contents of each of the so 
reduced video images included in the composite video 
image. 

[0015] Embodiments of the invention will now be 
described, by way of example only, with reference to the 
accompanying drawings in which: ss 

Fig. 1 is a block diagram showing the configuration 
of a video recording apparatus and a centralized 



A2 4 

monitoring recording system according to an exam- 
ple emtxxliment of the invention. 
Rg. 2 is a diagram for explaining the operation of a 
frame compositing unit in Fig. 1 . 
Fig. 3 is a diagram for explaining the operation of 
the frame compositing unit in Fig. 1 . 
Fig. 4 is a block diagram showing the configuration 
of a compression processing unit in Fig. 1 . 
Fig. 5 is a block diagram showing the configuration 
of a recording processing unit in Fig. 1 . 
Figs. 6A to 6C are explanatory diagrams showing a 
recording format of a video cassette tape. 
Fig. 7 is an explanatory diagram showing the struc- 
ture of a sub-code sector in a recording track of the 
video cassette tape. 

Fig. 8 is an explanatory diagram showing the struc- 
ture of a VAUX sector in a recording track of the 
video cassette tape. 

Rg. 9 is a diagram showing a data structure of a 

data pack "VAUX REC DATE". 

Rg. 10 is a diagram showing a data structure of a 

data pack "VAUX REC TIME". 

Rg. 11 is a diagram showing a data structure of a 

multi pack header. 

Rg. 12 is a diagram showing a general data struc- 
ture of a data pack positioned at the head of a multi 
pack group. 

Rg. 13 is a diagram showing a data structure of a 

date pack "GEN ERAL". 

'Rgs. Y4A tb"14G are explariatory diagrams showT 

ing some examples of a frame dividing method. 

Rg. 15 is a diagram showing a date structure of a 

date pack "REC TIME OFFSEr. 

Rg. 16 is a diagram showing a date structure of a 

date pack "CAMERA NAME". 

Rg. 17 is a diagram showing a date structure of a 

date pack "PRODUCT ID". 

Rg. 18 is a diagram showing a date structure of a 
date pack "USER DATA". 

Fig. 19 is a flowchart for explaining a frame com- 
positing process in the video recording apparatus of 
an example embodiment. 

Rg. 20 is a flowchart for explaining the operation 
from a process of generating additional date to a 
process of recording composite video date and the 
additional data onto a tape in the video recording 
apparatus of an example embodiment. 
Figs. 21 A to 21C are diagrams showing the corre- 
spondence between video images obteined from 
sixteen video cameras and divided parts in the 
case where a frame is divided into sixteen divided 
part. 

Rgs. 22A to 22F are diagrams showing the con^e- 
spondence between video images obteined from 
sixteen video cameras and divided parts in the 
case where a frame is divided into four parts. 
Rgs. 23A to 23E are diagrams showing an exanrple 
of recompositing one frame which is divided into 
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sixteen parts based on four composite frames each 

, . of which.is.divided-into.four parts 

Figs. 24A to 24E are diagrams showing the corre- 
sp ondenc e b etwe en video images obtained from 
sixteen video carneras arid divided parts in the 
case where a frame is divided into eight parts. 
Figs. 25A to 25E are diagrams for explaining a 
processing method of compositing a frame by cap- 
turing and reducing a plurality of video images, not 
intermittently, but continuously 

[0016] Fig. 1 shows the corrfiguration of a central- 
ized monitoring recording system Including a video 
recording apparatus according to an example embodi- 
ment of the invention. -The centralized -monitoring 
recording system according to the embodiment Is 
applied to record monitoring video Images captured in a 
plurality of places in a lump. Since a video recording 
method according to an embodiment of the Invention is 
embodied by the video recording apparatus of the 
emkxxiirnerit," it~wiirbe also descrit5ed'h"ereinbelow. ~ 
[001 7] The centralized monitoring recording system 
according to the embodiment comprises an external 
input device 100 and a video recording apparatus 200. 
Input video data D|n from the external Input device 100 
is supplied to the video recording apparatus 200 
[0018] The external input device 100 comprises a 
plurality of video cameras 101 each for capturing 
images in an area to be monitored, a plurality of A/D 
convertersJ02 for A/D (analog-to-digital) converting_a_ 
plurality of image signals outputted from the plurality of 
video cameras 101 , and a multiplexer 103 for selectively 
obtaining output data of the A/D converters 102 in a pre- 
determined order and outputting the input video data 

D|N- 

[0019] The multiplexer 103 has a plurality of^ Input 
terminals 103a to which output signals from^the A/D' 
converters 102 corresponding to the plurality of video 
cameras 101 are supplied and an output terminal 103c 
to be connected to one of the Input terminals 103a. In 
the multiplexer 103, when the input terminal 103a con- 
nected to the output terminal 103c is switched to 
another input terminal 103a at a predeterrnined timing, 
an output signal of the A/D converter 1 02 is outputted as 
the Input video data Pin in a frame unit from ttie output 
terminal 103c. As a result, when attention is paid to a 
specific video camera 101. video images captured by 
this video camera 101 are intermittently (with intervals 
in time) supplied to the video recorcfing apparatus 200. 
In the case of a video signal of an interlace system in 
which one frame is comprised of two fields, the switch- 
ing of the multiplexer 103 is performed field by field. In 
the following, description will be given on the assump- 
tion that the video signal is a signal of the NTSC 
(National Television System Committee) system. 
[0020] The video recording apparatus 200 com- 
prises: a frame composition unit 1 for generating one 
composite video frame by compositing a plurality of 



frames of the input video data D|n from the multiplexer 

. 1.Q3;_ajcprnprjBSsion,processing_unit 2 forrampressirig, 

output data of the frame compositing unit 1 ; and a CPU 
(Central Processing Unit) 3 for controlling the operation 

's — bfWch~of'thenjhits"in"the~\/ideo~re<X)rding apparatt^^ 
200. The video recording apparatus 200 also com- 
prises: a merrK>ry 4 for temporarily storing additional 
data outputted from the CPU 3; a memory unit 5 for per- 
forming processes such as a process of tenrtporarlly 
10 storing composite video data compressed by the com- 
pression processing unit 2 and the additional data out- 
putted from the memory 4; and a recording processing 
unit 8 for performing a process for recording the com- 
posite video data and the additional data outputtad fronri_ 

75 the memory unit 5 onto_a video cassettejape _7, Mainly,^ 
the frame compositing unit 1 corresponds to an exam- 
ple of "composite video generating means" in the inven- 
tion. Mainly, the CPU 3 corresponds to an example of 
"additional information generating means" in the Inven- 

20 tion. Mainly, the recording processing unit 8 arKi the 

— -CPU 3 correspond to examples of "recording means" in^ 
the invention. 

[0021] In Fig. 1, each arrow with a solid linejndi- 
cates the flow-of video data and additional data.„Each 

25 SLvrow with a broken line indicates the flow of a control 
signal. - - 

[0022] The frame compositing unit 1 has a memory 
1 1 for temporarily storing the Input video data Din C)ut- 
putted from the multiplexer 103 in the external input 

30 device 1 00;_and ji jriernory controller 12 for desig natin g 
an address at the time of writing data to the memory 1 1 
and at the time of reading data from the menrx)ry 1 1 . 
The input video data Din of one frame captured by one 
of the video cameras 101 in the external input device 

35 100 has, for example as shown In Fig. 2. a data struc- 
ture of 720 dots X 480 lines. 

[0023] ~The memory controller 12 performs a~sam-~ 
pling process in a procedure which vhfill be described 
hereinlater on the input video data D|n in each video 
40 frame, thereby forming a reduced video image having a 
data structure ot for example. 360 dots x 240 lines as 
shown in Fig. 2 and combining a plurality of reduced 
video imagesjo generate one composite video frame. 
For example, in the example of Fig. 2, video images in 
45 four frames_Fh to FI4 c aptured byjhe video camereis 
are reduced to generate four reduced video images PI 
to P4. Further, by combining the reduced video images 
PI to P4. a composite video frame Fc is formed. When 
the input video data D|n from the multiplexer 103 is sup- 
so plied on a field unit basis, for example, first, one frame is 
generated from two fields and, after that, sampling is 
performed, thereby forming a reduced video image. 
Although the case of generating one composite video 
image from four video images is shown In Fig. 2, as will 
55 be descrit>ed hereinlater. a composite video image can 
be also generated from video images of the number 
larger or smaller than four. 

[0024] The process of generating the composite 
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vide o fram e Fc from the reduced video images PI to P4 
in Fig. 2 is realized by designating an address in the 
memory 11 by the memory controller 12. For example. 

-it is realized in the followlng-mannerrAt the stage of writ-- 
ing the reduced video image onto tiie memory 1 1 . the 
memory controller 12 divides the memory 11 into four 
blocks so that the data arrangement of the reduced 
video images Pi to P4 are the same as that of the com- 
posite video frame Fc, and designates an address in 
each block. At the time of reading of data, the read 
address is sequentially designated from the head by 
using the whole memory 1 1 as one block. On the con- 
trary, at the stage of writing the reduced video irnage 
onto the memory 11. data constructing the~reduced 
video images PI to P4 is sequentially written from the 
head by regarding the memory 1 1 as one block. At the 
time of reading the data, the address designation is per- 
formed in the order so that the arrangement of the data 
of the reduced video images PI to P4 becomes ^e 

^same-as4hat-ef4he-composite-video^frame Fc ^ 
[0025] Figs. 3A to 3E show a state where video 
inoages from four video cameras 101 are inputted and a 
composite video image is generated. Each of Figs. 3A 
to 3D shows a series of video frames obtained from the 
video cameras 101 and Fig. 3E illustrates series of gen- 
erated composite video frames. In Figs. 3A to 3D. a 
block element of one picture represents one frame. The 
video frame on the right side in the diagram is preceding 
wit h respect to time. As shown in the diagram, when 



10 



IS 



^20' 



25 



limited to four but ma y be 2, 3. or 5 or "^pi^^ "H^er 
of division of the composite video frame may be set irT" 
accordance with the number of sources of the input 

-videodata-Djisi— The-data-recording-speed-to-the-video- 
cassette tape 7 may be set to a value which is 1/2. 1/3 
or the like of the primary speed in accordance with the 
number of sources of the input video data D|]sj. 
[0029] When the number of sources of the input 
video data D|n is further generally expressed as "n** (n is 
an integer of 1 or larger), the number of division of the 
conrposite video frame assumes "n". In this case, one. 
frame of the input video data D||vi is set into one, of the, 
divided parts of the composite video frame at time inter- 

.vals of (n) frames. By setting the recording speed t o 1/n 
of the primary* speed, the length of recordable time'ih* 
the video cassette tape 7 can be increased by n times 
as long as that of the primary speed. 
[0030] In practice, a video image is recorded on the 
video cassette tape 7 as follows. Composite video 

=frames'Fc-are-stored'in=the-memory-5-at=time intervals- 
of a predetermined unit of frames. The composite video 
frame Fc stored in the.memory 5 is read out under.the 
control of th^mernory confroller 6 and recorded bnto^ 
the video cassette tape~7. The recording speed at this 
time is determined by the CPU 3 on_tiie tsasis of the 
number of signals (the nurnber of sources of the input 
video data Din) supplied as a part of the setup data 31 
and is sent_as recording speed information from the^ 
CPU 3 to the recording processing unit 8. The recording 



attention is paid to each of the video cameras lOlrit is 
understood that a video frame from one video camera 
101 is supplied intermittently (every four frames). 
[0026] In Rg.2 and Fig.3. the video recording appa- 
ratus 200 intermittently records the input video data Dug 
onto the video caseette tape 7 to thereby allow the long- 
time recording when' In'hormal mode (i.e.; intermittent" 
recording mode). 

[0027] More specifically, as shown in Fig.3. irrput 
video data D„vi intermittently read out from the mem- 
ory n. and as shown in Fig.2. the composite video 
frame Fc is formed by the memory controller 12 in such 
a manner that the intermittent video data is set comes 
into each of the divided part. In the case of Fig.'2; one 
composite video frame Fc is outputted from the frame 
'compositio7ruriit~l7at a time interval for captijting four" 
frames of the input video data D|m. When the com- 
pressed composite video frame Fc is recorded on the 
video cassette tape 7, the recording processing unit 8 
confrolles so that the video recording onto the video 
cassette tape 7 is performed not at a primary speed k>ut 
at a quarter speed. Consequently, the composite video 
frame Fc each of which is outputted at time intervals of 
capturing four frames of input data Di^ is continuously 
recorded on the video cassette tape 7. The length of 
recordat>le time onto the video cassette tape 7 at quar- 
ter speed is quadruple as compared with that at primary 
speed. 

[0028] The number of input video data Dim is not 



-30 — processingMjnit-8-corifrols~&ie-recording-speed~oifxlata - 
onto the video cassette tape 7 on the basis of the 
recording speed information. As the memory 5, a semi- 
conductor memory can be used. Besides, a disc- 
shaped recording medium such as a hard d^ or a 

35- magneto-optical disc may be used. 

[0031 ] ■ ^In thecase where the videoTecording'appa=" 

ratus 200 is applied to, for example, a monitoring sys- 
tem and video data is always intermittently recorded on 
the video cassette tape 7 as described at>ove, if an 

40 emergency occurs, it cannot be always sufficiently dealt 
with since there is a possibility that video frames corre- 
sponding to the decisive moments of the emergency are 
not fully Tecorded on the video cassette tape 7 "and" 
detailed investigation cannot be performed at a later 

45 date. 

[0032] In the video recording apparatus 200 of the 
emtxxiiment. when an emergency occurs, the recording 
mode can be therefore changed from the intermittent 
recording mode to a full recording niode. More epecifi- 

50 cally. in the case of emergency, video recording appara- 
tus 200 stops the intermittent capture of the input video 
data D|N from the plurality of video cameras 101 and 
starts an operation of capturing only the input video 
data D|N from the video camera 101 related to the emer- 

55 gency and recording all of the input video data Dug onto 
the video cassette tape 7. The switchirtg of the record- 
ing mode is performed, for example, in the following 
manner. 
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[0033] Each of the video cameras 101 is provided 

_.with ,an , abnorrnaljty„detecting_sensor (not _shown). 
When an abnormality detecting sensor detects an 
emergency, the abnormality detecting sertsor sends an 

~abnormalityTiotHicati5fras^ 5~ 
the CPU 3. Upon receipt of the abnormality detecting 
notification, the CPU 3 controls the multiplexer 103, the 
frame composition unit 1 . and the recording processing 
unit 8 to switch the recording mode from intermittent 
recording mode (normal mode) to the full recording io 
mode (emergency mode). To be specific, the CPU 3 
stops the switching operation of the multiplexer 103 so 
that only the input video data D||^ from the video camera 
101 of which abnormality, detecting sensor detects the 

- emergency is supplied to the frame.composition unit 1 . _75 
The CPU 3 also controls the frame composition unit 1 
so that the input video data Di^ outputted from the mul- 
tiplexer 103 is supplied as it is (i.e.* without composition 
process) to the compression processing unit 2. Further, 
the CPU 3 controls the compression processing unit 8 go 

^so that compressed video data outputted from the mem—-^^ 
ory 5 is recorded onto the video cassette tape 7 at the 
primary speed. The CPU 3 may control the compres- 
sion processing unit 8 so that the video data outputted 
from the frame composition unit 1 is not compressed but gs 
is sent as it is to the memory 5 and recorded. 
[0034] With such a configuration, under normal cir- 
cumstances, the video recording apparatus 100 inter- 
mittently-captures video images from the plurality of_ . . 

„video_cameras J.0.1 ._compresses_and_cornposites Jthe^^ 
video images and records the resultant data onto the' 
video cassette tape 7 at a 1/n speed. In the event of an 
emergency, the video recording apparatus 100 can 
record only video images from a desired video camera 
101 onto the video cassette tape 7 at the primary 35 

^eed: As a result; video irmgesat many places can be "~ 
recorded evenly for a loh^^meTirid^r ri^^ 
stances. On the other hand, in the event of an emer- 
gency, video images of the place where the emergency 
occurs can be recorded fully, so that detailed investrga- 4o 
Won can be made at a later date. 
[0035] Fig. 4 shows the configuration of the com- 

. pressjoTLprocessing unit 2. The compression proc ess- 
ing unit 2 has: a block forming circuit 21 for dividing 

_ supp^lied v^eo datajnto predete rmined data blocks: a 4S 
shuffling circuit 22 for reanranging the data blocks 
divided by the block forming circuit 21 into a predeter- 
mined shuffling pattern; a DCT circuit 23 for performing 
a DCT (Discrete Cosine Transform) process on output 
data of the shuffling circuit 22; a quantizing circuit 24 for so 
quantizing output data of the DCT circuit 23 in accord- 
ance with quarrtization characteristics based on a quan- 
tization table: a data amount estinnating unit 25 for 
estimating a data amount from a coefficient of the DCT 
after the DCT process in the DCT circuit 23 and switch- ss 
ing the quantization table in the quantizing circuit 24; 
and a variable length encoding circuit 26 for encoding 
output data of the quantizing circuit 24 in such a manner 



that the length of the encoded data is variable and out- 
_putting_jjBSuJtarit jdata. JThe compressed corrposite 
video data outputted from the variable length coding cir- 
cuit 26 is supplied to the memory unit 5. The compres- 
~sion~prdcessirig~unit 2 can"also~have~anconfiguration 
obtained by eliminating, for example, the data amount 
estimating unit 25 from the above configuration. The 
configuration of the compression processing unit 2 is 
not limited to the system shown in the diagram but can 
be of another system. 

[0036] The CPU 3 always monitors a switching tim- 
ing of the multiplexer 103 in the external input device 
100 and controls a frame compositing process in the 

_ frame compositing _unit .1 on the basis^ of _the. switching 
timing. Specif ically. for example, when it is assumed that 
one composite video image is generated on the basis of 
video images from four video cameras 101, the CPU 3 
notifies the memory controller 12 in the frame compos- 
iting unit 1 of the switching timing of the multiplexer 103. 
Corrcequerttly, an operation of supplying data from the 

"hiultiplexer T03"tb"^the"fr£fln cdmpasitihg~unit"ir sam-- 
pling in the frame compositing unit 1 , and an operation 
of writing reduced video data generated by the sarnpling 
to the memory 1 1 are synchronously performed. When 
the writing of the four reduced video data to the memory 
1 1 is finished by the control of the memory controller 12 
and the reading of data from the memory 1 1 is started, 
the reading start timing is notified to the CPU 3. As 

.^described above, the CPU 3 can always grasp the proc- 

_ess progressing state in_the frame compositing unit 1 . 
[0037] Similarly, the CPU 3 transmits/receives a 
control signal to/from the compression processing unit 2 
and also grasps the progressing state of the compress- 
ing process. 

[0038] The CPU 3 further executes a process of 
generating various additional data with respect to video 

"frafriesTcaptured by the frame comp^itinglinit^l^iartKe* 
multiplexer 103 and writing the data to the memory 4: 
The address designation at the tme of the writing oper- 
ation is performed by a menrK>ry controller 6 under the 
control of the CPU 3. The additional data written to the 
memory 4 is read by the address designated by the 

_ir®!™''y_coritrqner 6 arid vyritten t o th e memory unit 5 . 
The transfer, of the additional data is carried out in syn- 
chro nization witii the writing of the composite video data 



from the compression processing unit 2 to the memory 
unit 5. 

[0039] The additional data includes frame division 
configuration information indicative of a dividing config- 
uration of the composite video frame generated by the 
frame compositing unit 1 (that is, the maximum number 
arxJ arrangement of reduced video images which can 
be included in one composite video frame), recording 
date and time information indicative of recording date 
and time of video data obtained according to a capture 
signal as a switching timing notification from the multi- 
plexer 103, camera identification information and cam- 
era name information indicative of the number and 
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nam e of the video camera 101 whi ch has outputted the 

video image, various user information supplied from the 
outside, and recording apparatus identification Informa- 

"tion-given-to~the--video-recording— apparatus-itseH- 

Among them, the frame division configuration infonma- 5 
tion. camera identification information, camera name 
information, and recording apparatus identification 
information is fixed information preset by setup data 31 
from the outside. In the following description, each of 
divided parts in a composite video frame (composite w 
frame) will be called a "divided part" for short. The 
reduced video image is therefore allocated to and dis- 
posed in each divided part. ^ 

[0040]^ JTlie userjiriformation is indud^ed inJlcorrterrts, 
related information" in the invention. For exampleTwhen' Is 
the video camera 101 is disposed near an automatic 
teller machine (ATM) in a bank, the user information is a 
transaction number, a card number, date, time and the 
like obtained from a cash card of a customer by the ATM 

^synchronously- with^image^capture7=The-user=informa=— 20™ 
tion includes alarm information in the case where some 

troutale ocojrs^ The i^eMnforn^ t his-kind can b e - 

supplied as external input data 32 to the CPU 3 via a 
serial transmission line such as RS232C. The detailed 
structure and recording format of the additional data will 
be described hereinlater. 

[0041] Fig. 5 shows the configuration of the record- 
ir^ processing unit 8. The recording processing unit 8 is 
to perf orm a process of re cording the conrp osite vi deo 
~data and additional data outputted from the memory 



arrangement pattem on a tape 70, and Fig. 6C illus- 
trates a recording format on one track. 
[0046] As shown in Rgs. 6A and 6B. one frame is 
"dividedlnto'ten areas T0"to"T9rData'in'the"arieas"T0-to~ 
T9 is recorded in corresponding ten tracks TRO to TR9 
of the tape 70. Actually the video data corresponding to 
each of the areas TO to T9 of the frame is not recorded 
as it is onto the tracks of the tape 70 in tiie video cas- 
sette tape 7. The data is subjected to a shuffling proc- 
ess, a sync block forming process, a deshuffling 
process, and the like by the compression processing, 
unit 2 and the resultant data is recorded.on.each track.„ 

10047] ^ sho wn in Fig. 6C, one t rack includes a n 

ITI (Insert and Track Information) s ector- 71 . an audio 
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sector 72, a'video^sectidn 73. and a^subcoSe sector74 " 
in this order. The ITI sector 71 is located so as to 
encounter first of sector with the recording head. The ITI 
sector 71 includes a TIA (Track Information Area) for 
storing information regarding a track such as track pitch. 
-an-APT-'(Application-ID-of-a=Track)-indiGating-that=the- 
tiack data structure of the tape 70 is for either consumer 
-or professional us e;-T he audio^s e ctor 72 is an-area^on 
which audio data is recorded, and includes an ID part 
(not shown) and an AAUX (Audio Auxiliary) -area (not 

shown) in which audio auxiliary data is stored. 

[0048] The video sector 73 is an area in which video- 
data is recorded, and includes an ID part (not shown) 
and VAUX^CVideo Auxiliary) areas-73a and 73bJn_wh[ch 
video auxiliary data is stored. The additional data dealt 



unit 5 onto the video cassette tape 7 and h^ an ECC 
(Error Correcting Code) processing unit 81 . a channel 
coding unit 82 connected to tiie ECC processing unit 
81 , a recording head unit 83 connected to the channel 
coding unit 82; and a mechanism -unit 85~including a 
■ traveling sJ^tOTlaf "thel/ideo^ssette tape 
unit of a rotary drum, and the like. The recording head 
unit 83 includes a recording head and the like. 
[0042] In the recording processing unit 8. at the 
time of a recording operation, an ECC is added to tiie 
output data of the memory unit 5 by the ECC processing 
unit 81 . channel coding for transforming data into a for- 
mat adapted to be recorded isperfdrrned by thechannel 
coding unit 82. and recording is performed onto the 
videb"cassette~tape"7 by tfie"~rec6rdihg KeS"in the' 
recording head unit 83. 

[0043] Reference to Figs. 6 to 1 8. the recording for- 
mat of tiie video data and additional data recorded on 
the video cassette tape 7 and the details of the addi- 
tional data will be explained. 

[0044] First, reference to Rgs. 6 to 8, the outline of 
the recording format of the video data and additional 
data recorded on the video cassette tape 7 will be 
described. 

[0045] Figs. 6A to 6C show a recording format, 
what is called a DV (Digital Video) tape format, applied 
to the video cassette tape 7. Rg. 6A shows a video 
image (still image) of one frame. Fig. 6B shows a track 



-30 in the embodimerrt-is-mainly recorded in the-VAUX- 
areas 73a and 73b. The subcode sector 74 includes an 
ID part (not shown) and subcode data. The subcode 
data includes, data mainly for high-speed searching, 
absolute track numbers necessary for tape manage-' 
35 ment-a-title time code -functioning-as-a tape -counter,- 
"* * arxJ the like. The titie^^time'code'expresses the absolute^ 
address of each frame by hour/minute/second and the 
frame number when the head of the tape 70 is used as 
a reference 0. Each of the video sector 73 and the audio 
40 sector 72 consists of a plurality of sync blocks each hav- 
ing a length of 90 bytes. The subcode sector 74 consists 
of a plurality of sync blocks each having a predeter- 
^rriihedlengthT" 

[0049] Fig. 7 shows the structure of data recorded 
~45~ "irfthe subcbde"sectdr74"showfriFRgr6rih~Fi 

columns extending in the vertical direction correspond 
to tracks of the track numbers TRO to TRO and rows 
extending in the lateral direction con^espond to sync 
blocks of the sync block numbers 0 to 1 1 . In this case, 
so "1 3" denotes a sync Nock in which the trtie time code is 
recorded, "62" indicates a sync block in which a data 
pack "REC DATE" storing the absolute value of 
year/month/date of recording is recorded, "63" denotes 
a sync triock in which a data pack "REC TIME" storing 
55 the at>solute value of recording time is recorded, and 
"FF" denotes a sync block including no special informa- 
tion. The data packs "REC DATE" and "REC TIME** will 
be described hereinlater. 
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[0050] Fig. 8 shows the structure of data recorded 
- in the--VAUX areas 73a and 73b in the video sector 73 
shown in Fig. 6. In Fig. 8, the columns extending in the 
vertical direction correspond to tracks of the track num- 
bers TRO tb TR9 and the rows extending in the lateral 
direction corresporxj to sync blocks of the sync block 
numt»ers 0 to 44. 

[0051] *'60'* denotes a sync block in which a data 
pack "VAUX SOURCE" storing information indicative of 
a supply source, kind, and the like of a video image is 
recorded and "61 " indicates a sync t^lock in which a data 
pack "VAUX SOURCE CONTROL" storing various con- 
trol information regarding a supply source, kind, and the 
like of a video image is recorded. ... 
[0052] "FO" denotes a sync block in which a data 
pack "MAKER CODE" storing information indicative of 
the manufacture of the monitoring system is recorded. 
"FD" denotes a sync block in which a data pack "MULTI 
PACK HEADER" mainly declaring that it is the head 
pack of a series of data packs is recorded. "FE" indi- 
cates a sync block in which a data pack"MULTI USE 
PACK" as a dummy pack used for filling an not-used 
area in the VAUX areas:73a and^73b is recorded. "FF" 
indicates a sync block including no special information. 
[0053] "FB(0)" denotes a sync block in which a data 
pack "GENERAL" storing frame division configuration 
information expressing the configuration of dividing a 
conposite video frame, camera number information 
(camera identification -infornnation)j-Corresponcling to 
„ each divided part,_and the like, is .recorded. "FB(1)" 
denotes a sync block in which a data pack "REC TIME 
OFFSET" storing recording date and time information 
indicative of date and time of recording of each reduced 
video image included in the composite video frame is 
recorded. "FB(2)" denotes a sync t>lock in which a data 
pack "CAMERA NAME" storing camera name informa- 
tion is recorded. "FB(3)" indicates a sync block in which 
a data pack "PRODUCT ID" storing identification infor- 
mation of the recording apparatus is recorded. "FB(4)" 
indicates a sync block in which a data pack "USER 
DATA" storing user information is recorded. "FB(5)" 
denotes a sync block in which a data pack "SUM DATA' 
storing checksum data for error check is recorded. 
[0054] Reference to Figs. 9 to 18 main data pad^ 
in the additional data will now be described. 
[0055] Rg. 9 shows the data structure of the data 
pack "REC DATE" recorded in the sulxjode sector 74. 
Fig. 10 shows the data structure of the data pack "REC 
TIME" recorded in the subcode sector 74. As shown in 
the diagrams, one data pack consists of data PCO to 
PC4 of 5 bytes (40 bits). The head byte PCO shows the 
kind of the data pack and four bytes of PCI to PC4 indi- 
cate specific data contents. Each of the other data 
packs described hereinbelow has a similar structure. 
[0056] In the data pack "REC DATE" shown in Fig. 
9, the code "62h" in the head byte PCO indicates that 
the data pad< shows recording date of the video image 
(to be accurate, the date on which the video image 



(reduced video image) at the head is captured). In the 
following _.four_, bytes PCI to PC4, the recording 
year/month/date and the day of the week are recorded. 
Specifically. "DAY" represents the recording date (1 to 

5 31). "MONTH" shows the recording month (1 to'12). arid 
"YEAR" represents lower two digits (00 to 99) of the 
recording year (in the year of grace). Each of them is 
shown by a BCD (Binary Coded Decimal) code. 
"WEEK" shows the recording day of the week (Sunday 

10 to Saturday) in a binary code (000 to 110). Each bit of 
"DS". "TM"and "TIME ZONE" is fixed data (= "1"). 
[0057] In the data pack "REC TIME" shown in Fig. 
10. the code "63h" in the head byte PCO represents that 

the data pack shows recording time of the video_image 

15 (to be accurate, the absolute time when the head video 
image (reduced video image) is captured). In the follow- 
ing four bytes PCI to PC4, the recording time is 
recorded. Specifically, frame number (0 to 29) is stored 
in PCI , second (0 to 59) is stored in the PC2. minute (0 

20 to 59) is stored in PC3 and hour (0 to 23) is stored in 
~ PCA: Each of them is shown by a BCD code: "TENS of 
..." indicates tiie tens digit and "UNITS of ..." indicates 
the units digit. Each of the bits "SI" to "SB" is fixed data 
(= "1"). The data packs "REC DATE" and "REC TIME" 

25 are generated on the tjasis of a calendar timer function 
of the CPU 3. 

[0058] Fig. 1 1 shows a data structure of a data pack 
disposed at the head of a recording area of a plurality of 

^ . data packs (hereinbelow. referred to as a multi pack 

30 area) in the VAUX areas 73a and 73b. which is called a 
multi pack header. In the multi pack header, a code 
"FDh" declaring that the data pack and subsequent data 
packs are in the multi pack area is stored in the head 
byte PCO. "MULTI PACK DATA CODE" in PCI to PC2 

35 shows the use of the following plural data packs. In the 
~emt>odiment, it is fixed to data "003h" indicating that the 
data packs are used for monitoring (security). "TDP" in 
PC3 to PC4 shows the number of data packs following 
the pack. "TT indicates fixed data (= "1"). 

40 [0059] Fig. 12 shows a general form of the data 
pack positioned at the head of a group comprised of a 
series (a cluster) of data packs (hereinbelow. called a 
multi pack group) in a multi pack area subsequent to the 
multi pack header. In the data pack, a code "FBh" 

45 declaring that the data pack is at the head of the multi 
pack group is stored in the head byte PCO. In the 
emtxxjiment, "EXTENSION CODE" in PCI is defined 
as an extension for monitoring. The extension codes are 
defined as follows. 

so 

"0000": data pack "GENERAL" 
"0001": data pack "REC TIME OFFSET" 
"0010": data pack "CAMERA NAME" 
"001 1 ": data pack "PRODUCT ID" 
55 "0100": data pack "USER DATA" 
"0101": data pack "SUM DATA" 
"0110" to "1101": not used 

"1110": data pack "CONTINUE". To be specific, in 
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thejdata pack, data is continu^ from the immedi- _ 
ately preceding data pack. 
"1 1 1 1 no inforniation 



[0060] The data structure of each of the data packs s 
"GENERAr. "REC TIME OFFSET". "CAMERA 
NAME^ "PRODUCT ID", and 'USER DATA" will be 
desalbed hereinlater. 

[0061] "VERSION" in PCI indicates the version 
related to the code of each extension, the data structure io 
of the pack, and arrangement of packs in a part of the 
VAUX sector. In the example of the diagram, version 1 is 
shown. "NO OF PACKS" in PC2 indicates the number of 
data packs of the self pack and subsequent data packs. 
Each of PC3 and PC4 is properly defined according to is 
the kind of the data pack. 

[0062] Fig. 13 shows the data structure of the data 
pack "GENERAL". The data pack comprises the head 
data pack GO having the structure shown in Fig. 12 and 
sutjsequent three data packS'Gl to G3. The meaning of - 20- 
each of PCO and PCI in the head pack GO is as 

described in Fig. 12. "EXTENSION CODE" is set to 

"0000", that is. "GENERAL". In the ennbodimerit, "NO^ 
OF PACKS" in PC2 in the head data pack GO is set to 
"03h". that is, three packs. The value changes accord- 2S 
ing to the nurnt>er of division of a frame. 
[0063] Each bit in PC3 and PC4 in the head data 
pack GO has data indicating whether a reduced video 
image exists in each divided part of a cornposrte vide 
frame or not. In the embodiment, one composite vide - 30 
frame can be divided into sixteen divided parts at maxi- 
mum and each of video images from sixteen video cam- , 
eras 101 can be displayed as a reduced vkleo image on 
each divided part. Each of bits El to E 16 of PC3 and 
PC4 in the head- data pack GO shows whether a 35 
' reduced video" image exists^ih' eachljf the*1 6" divided" ~ 
parts or not by "1" or "0". For example, when the bit El 
is "0". it shows that no reduced video image exists in the 
first divided part. More specifically, when the composite 
video is displayed on a screen of a predetermined dis- 40 
play device, the area on the saeen corresponding to the 
first divided part (DIVISION-1) is in a blank display 
state. 

[0064] The meaning of each of PCO and PCI in 
each of the subsequent data packs G1 to G3 is as 45 
explained with reference to Fig. 12. For example, the 
lower four bits "1110" of PCI in the data pack indicates 
"CONTINUE", that is. the data is continued from the 
immediately preceding data pack. 

[0065] "NO OF CAMERAS" in PC2 in the data pack so 
G1 expresses the installation numt^er of the video cam- 
eras 101 in four bits. "DIVIDE MODE" represents a divi- 
sion form of a composite video frame as shown in Fig. 
1 4 in four bits. Figs. 1 4A to 1 4G show the kinds of a divi- 
sion form of a composite video frame. Fig. 1 4A shows a ss 
case where no division is performed. Fig. 14B shows a 
case where a composite frame is divided into two parts 
in the vertical direction. Fig. 140 shows a case where a 



composite fram e is divi ded int o four parts in total, two 
parts in the vertical direction and two parts in the lateral 
direction. Fig. 14D shows a case where a composite 
-frameisdivided-into-eightparts-in-totalrtwo-parts-in-the 
lateral direction and four parts in the vertical direction. 
Fig. 14E shows a case where a composite frame is 
divided into eight parts in total, four parts in the lateral 
direction and two parts in the vertical direction. Fig. 14F 
shows a case where a composite frame is divided into 
nine parts in total, three parts in each of the lateral and 
vertical directions. Fig. 14G shows a case where a com- 
posite frame is divided into 16 parts in total, four parts in 
each of the lateral and vertical cfirections. 
[0066] Each of "CAMERA No. (DIVISION-I)" to 
"CAMERA No. (DIVISION-1 6)" in PC3 and PC4 in the 
data pack G1 and in PC2 to PC4 in the data packs G2 
and G3 expresses the camera number of the video 
camera 101 which has captured the reduced video 
image displayed on each of the divided parts (DIVI- 
SION-I to DIVISIGN-16) in four bits.- - ~ - 
[0067] Fig. 15 shows the data structure of the data 
pack " REC TIME OFF SET". The data pack includes 
data which expresses capture time of the reduced video 
image in each divided part of a composite frame. Each 
capture time means an offset (differential data) from the 
capture date-and-time (absolute time) stored in the data 
packs "REC DATE" and "REC TIME" in the subcode 
sector 74. The data pack "REC TIME OFFSET" is gen- 
erated by using t he calendar timer fun ction of the CPU 

[0068] The meaning of each of PCO and PC1 in the 
head data pack RO is as explained in Fig. 12. "EXTEN- 
SION CODE" is set to "0001", that is. "REC TIME OFF- 
SET". In the embodiment. "NO OF PACKS" in PC2 in 
the head data pack RO is set to "1 Oh", that is. 16 packs. 
The value changes"according to the^number of division ■ 
of a frame. 

[0069] Each of the following data packs R1 to R16 
represents offset information irxficative of the capture 
time of each of the reduced video images in the divided 
part (DIVISION-1 to DIVISION-1 6) by minute, second 
ard frame. For example, the absolute capture time of 
the reduced video image on a divided part (DlVlSION-i) 
is therefore obtained by adding data of data pack Ri to 
the capture date and time stored in the data pack5""REC 
DATE" and "REC TIME" (Figs. 9 and 10) in the subcode 
sector 74. In this case, i 1 to 16. When attention is 
paid to. for example, the data pack R1 . in PC2, offset 
information indicative of capture time of the reduced 
video image on the divided part (DIVISION-1) is stored 
in the unit of the frame number of the reduced video 
image (1 to 29). In PC3. offset information indicative of 
capture time of the reduced video Image is stored in the 
unit of second(s) (0 to 59). In PC4. offset information 
indicative of capture time of the reduced video image is 
stored in the unit of minute(s) (0 to 59). The other 
divided parts (DIVISION-2 to DIVISlON-16) are similar 
to the akkove. 
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[0070] The meaning of PCO and PCI in each of the 
data packs R1 to R16 is as described in Fig. 12. For 
example, the lower four bits of PC1 in each data pack 
represents "CONTINUE", that is. data is continued from 
""the* immediately preceding "data~packr Any "of "SI" to" 
"S4" is fixed data {= "1"). 

[0071] Rg. 16 shows the data structure of the data 
pack "CAMERA NAME". The data pack indicates the 
name of a camera of each camera number defined by 
the data pack "GENERAL" shown in Fig. 13. As a cam- 
era name, it is preferable to use the name of a place in 
which the video camera is installed. For example, 
"entrance", "locker room", "lobby", "ATM-No. 1". and the 
like are used. 

[0072] -The meaning of PCO and PCI in the head 
data pack CO is as described in Fig. 12. "EXTENSION 
CODE" is set to "0010". that Is. "CAMERA NAME". In 
the embodiment. "NO OF PACKS" in PC2 in the head 
data pack CO is set to "OSh", that is, three packs. The 
value changes according to the number of video cam- 
eras. ... - ^ 
[0073] "CAMERA No." in PC3 in the head data pack 
CO denotes any of the camera number (1 to 16) defined 
by the data pack "GENERAL" shown in Fig. 13. 
[0074] In each of PC4 in the data pack CO and PC2 
to PC4 in the subsequent data packs Cl to C3, data 
expressing characters of the camera name by an ASCII 
code is stored. In the embodiment, therefore, 10 charac- 
ters (CHARACTER-1 to CHARACTER-9) can be set as 

the name.of a camera._ 

[0075] Fig. 17 shows the data structure of the data 
pack "PRODUCT ID". The data pack is used to store 
recording apparatus identification informaton for speci- 
fying a video recording apparatus used for recording a 
video image. The recording apparatus identifying infor- 
~ mation is important to increase an evidence effective- 
ness of the" recorded video image wheh~some trouble" 
occurs. 

[0076] The meaning of PCO and PCI in the head 
data pack PIO is as described in Fig. 12. "EXTENSION 
CODE" is set to "0011", that is, "PRODUCT ID". In the 
embodiment, "NO OF PACKS" of PC2 in the head data 

pack PIO is set to "02h", that is, two packs._^ 

[0077] In PCS in the head data pack PIO and PC2 to 
PC4 in the subsequent data packs PI1 and PI2. identifi- 
cation information indicative of the manufacturer of the 
video camera 101 "Corporate ID". "Company ID" and 
"Division ID" and identification information "Model ID" 
indicative of the model number (for example, production 
number) of the video recording apparatus are stored. 
[0078] Fig. 18 shows the data structure of the data 
pack "USER DATA". The data pack is used to store var- 
ious user information inputted as the external input data 
32 (Fig. 1) from an external system. The user informa- 
tion includes, as described atx>ve, the alarm information 
in the case where some trouble occurs, and transaction 
numt>er, card number, date, and time obtained from a 
cash card of a customer by the ATM synchronously with 



capture of an image by the video camera. The informa- 
tion is important to analyze, the recorded video images 
later. 

[0079] The meaning of PCO and PCI in the head 
"5" "data pack U0~is"as described in FigT 12. "EXTENSION 
CODE" is set to "0100". that is, "USER DATA". In the 
embodiment. "NO OF PACKS" in PC2 in tfie head data 
pack UO is set to "OSh". that is. eight packs. 
[0080] In "DIVISION No." in PCS in the head data 
10 pack UO. data (1 to 1 6) indicative of the correspondence 
between the user information and each of a reduced 
video images on divided parts is stored. Consequentiy. 
each video camera 101 can t>e associated with the user 
information. 

75 - [0081] In PCI to PC4 in the subsequent data packs 
U1 to U8. tiie user information "USER DATA-0" to 
"USER DATA-31" of total 32 bytes is stored. 
[0082] The operation of the video recording appara- 
tus having the configuration as mentioned above will 

20 how be described. In the following description, the video 
" recording method according to the embodiment will be 
also explained. 

[0083] First, with reference to the block diagram 
shown in Fig. 1 and the ftowcharts shown in Rgs. 19 

25 and 20, the main operation of the video recording appa- 
ratus according to the embodiment will be described. 
Fig. 19 mainly shows a schematic operation of the 
memory controller 12 in the frame compositing unit 1. 
Fig. 20 shows a schematic operation of the CPU 3 and 

30 the memory controller 6. As an exannple. the case of 
compositing video images of four systems captured by 
the four video cameras 101 into one composite video 
frame will be explained here. 

[0084] Each of the video cameras 101 in the exter- 
35 nal input device 100 supplies a captured analog video 
image to each of the A/D converters 102. The A/D con- 
' verter 102 converts the inputled'ahalog video image to 
digital data and supplies the digital c^ta to the multi- 
plexer 103. By sequentially selecting one of the inputted 
40 digital video images, the multiplexer 103 intermittentiy 
captures the video images of four systems as shown in 
Figs. 3A to 3D. 

[0085] The input video data Dim captured by the 
multiplexer 103 is supplied to the frame compositing unit 

45 1 . The memory controller 1 2 in the frame compositing 
unit 1 performs a process of reducing each of four video 
images and compositing reduced video images into one 
composite video image by a procedure as shown in Rg. 
19. Specifically, in Rg. 19. when a capture signal out- 

50 putted according to the switching timing in the multi- 
plexer 103 is received via the CPU 3 (Y in step S101). 
the memory controller 12 receives a frame of input 
video data and stores it as it is in the buffer area in 
the memory 1 1 (step SI 02). 

55 [0086] The memory controller 12 reads a frame of 
video data stored in the buffer area in the memory 1 1 
while sampling it and writes it into a predetermined 
block in the work area in the memory 11. At this time. 
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the memory corrtroller 12 designates the writing^ 
address on the basis of the frame division configuration 
information given by the CPU 3. thereby executing 
-memory-mapping-correspondingto-the-arrangementof- 
the divided parts in the composite video frame (step 
SI 03). 

[0087] Similarly, the memory controller 12 writes 
reduced video data in the second to fourth frames into 
the work area in the memory 1 1 (steps 8101 to 8103). 
When four frames of input are completed (Y in step 
SI 04), the memory controller 12 reads the data 
sequentially from the head address in the work area in 
the memory 1 1 and outputs it (step Si 05). As shown in 
Fig. 3, four frames of video images which are captured 
by the four video cameras 101 and inputted in the time 
division manner are reduced, and a frame of composite 
video image is generated. 

[0088] The composite video image generated by 
the frame compositing unit 1 is supplied to the compres- 
^sion processing=unit 2=and'Compressed, and result data- 
is outputted. 

[0089] - In Fig. 20, on the basis of-tiie setup"data 31 
supplied from the outside, the CPU 3 generates addi- 
tional data such as the data pack "GENERAL" including 
the frame division configuration information and camera 
identification information, the data pack "CAMERA 
NAME*" including the camera name, and the data pack 
"PRODUCT ID" including the recording apparatus iden- 
tification information and stores tfie additional data into 
the memory 4 (step S201 in Fig. 20). 
IQOQO] When the capture signal is supplied from the 
multiplexer 103 (step 8202 in Fig. 20). the CPU 3 gen- 
erates the additional data such as the data pack "REC 
TIME OFFSET" including the recording date and time 
information and the data pack "USER DATA" including 
"user information on the basis'of the input timing of the ^ 
capture signal, the frame division configuration informa- 
tion, and the external input data 32, controls the mem- 
ory controller 6, and writes the data packs into the 
memory 4 (step S204). 

[0091] The CPU 3 controls the memory controller 6 
to transfer and write the additional data (data packs) in 
the memory 4 to the memory unit 5 synchronously with 
the transfer of the composite video data from the com- 
pression processing unit 2 to the memory uhit~5. At this 
time, the memory controller 6 designates a write 
address so as to perform the memory mapping corre- 
sponding to the recording format (Figs. 6 to 8) on the 
tape 70 (step S205). 

[0092] The CPU 3 controls the memory controller 6 
to allows the data in the memory unit 5 to be outputted 
to the recording processing unit 8 in accordance with an 
order from the head address and to be written onto the 
tape 70 (step S206). By the process, the composite 
video data and additional data is recorded in the 
arrangement as shown in Figs. 6 to 8 in the subcode 
sector 74 and the VAUX areas 73a and 73b in the video 
sector 73 of the tape 70. 



[0093] _ As m entioned above, according to the video 
recording apparatus, video recording method, or cen- 
tralized monitoring recording system of the emtxxli- 
ment—the-video-images-from-the-plurality-of-video 

5 cameras 101 are captured while sequentially switching 
them, the captured video images are reduced to gener- 
ate reduced video images, the reduced video images 
are displayed on divided parts to thereby generate a 
composite video image, and the composite video image 

10 is recorded on the video cassette tape. Thus; the video 
images from the plurality of vkleo cameras can be 
recorded at high density, thereby enabling tonger-time 
recording to be realized by using a tape of a limited 
length. According to the embodiment, the additional 
'is data related to each reduced video image is generated 
and the composite video image and additional data is 
recorded on the same video cassette tape while main- 
tainir^ the correspondence between each of the 
reduced video images and each of the additional data, 

^o-^so.that-the additional information can be.obtained every 
reduced video image of each divided part. By using the 
additional data, a desired reduced video image.can be^ 
retrieved from the recorded cornpKDSite video image~arKi 
the retrieved reduced video image can be analyzed. 

26 [0094] When the composite video image recorded 
t>y the video recording apparatus of the embocfiment is 
reproduced using a display device, the video image 
captured by the same vkjeo camera 101 is always dis- 
played on one of the divided parts in the screen of the 

30 display device. Either by displaying the composite video 
image and the additional data upon the recording of 
them or by immediately reproducing the composite 
video image and the additional data which is once 
recorded, the states of a plurality of places can be 

35 simultaneously monitored on one screen almost in-a 
real time manner from both of the aspects of the video 
image and the additional information. 
[0095] According to the video recording apparatus 
of the emt)odiment, by switching the video inr^ages out- 

40 putted from the plurality of video cameras 101 in the 
time division manner, the video images of each video 
camera are intermittently captured. While using the 
video cassette tape 7 of a limited recording capacity, 
recording of longer time can be therefore realized. Fur- 

45 ther, according to the video recording apparatus of the 
embodiment, since the video image is compressed and 
recorded, longer time recording can be performed. 
[0096] The case of reducing and compositing video 
images from the four video cameras 101 to generate 

so one composite video image has been explained as an 
example in the description of the operation of the 
embodiment. For example, also when video images 
from two, eight, nine, or sixteen video cameras 101 are 
composited to one frame in a manner shown in Fig. 14, 

55 the basic operation is similar. For exanrple. as shown in 
Fig. 21 A. when video images CI to C16 from 16 video 
cameras 101 are composited into one frame, the* video 
images CI to C16 are allocated to 16 divided parts 01 



11 

DOCtD: <EP 1 03051 9A2.I_> 



21 



EP1 030 519 A2 



22 



to D16. respectively, as illustrated in Figs. 21B. 21C. .... 

[0097] — The installation numtjer of-the-vldeo-cam- 

eras 101 and the frame division nun^er (the number of 
division i n a c omposite video frame) do not always have 
to coincide with each" other. For ©caripfeT as^howh in 5" 
Fig. 22A. it is also possible to divide the video images 
CI to C16 from the 16 video cameras 101 into four 
groups each of which has four video images and gener- 
ate one composite video image from four video images 
of each group. Specifically, the video images CI to C4 io 
of the first group are respectively allocated to divided 
parts D1 to D4 of one composite video frame as shown 
in Rg. 22B. the video images C5 to C8 in the second 
. group are respectively, allocated-to.divided-parts D1 .to 
D4 in the next composite video frame as illustrated in is 
Fig. 220, the video images C9 to C12 in the third group 
are respectively allocated to divided parts D1 to D4 of 
the following oorrposite video frame as shown in Fig. 
22D, and the video images CI 3 to CI 6 in the fourth 
group are respectively £illocated to the divided parts D1 20 
to D4 of the following composite video frame as shown 
in Fig. 22E. Similarly, the process of generating the 
composite video frame 22B_to 22E:is. repeated. _ _ 

[0098] In the case of reproducing just as it is the 
composite video image recorded in a manner shown in 25 
Fig. 22 using a display device, the video images from 
different video cameras 101 are sequentially displayed 
in one of the divided parts in the saeen of the display 
device. In this case, for example, as shown in Figs. 23A- 
„ to 23E,_each of the reduced video images on the divided^ 30 
parts in a series of four composite video frame shown in 
Figs. 23A to 23D is further reduced at the time of repro- 
duction. The further reduced video images are rear- 
ranged and allocated to the 16 divided parts as shown 
in Fig. 23E. thereby generating and displaying one com- 35 
posite video frame. Consequently, the video images 
captured by the same video camera.101 can be always 
displayed in one of the divided parts in the composite 
video frame on the screen. 

[0099] For example, as shown in Fig. 24A. it is also 4o 
possible to divide the video images Cl to C16 from the 
16 video cameras 101 into two groups each having 
eight video images and generate one composite video 
frame from the video images of 8 systems from the 
video cameras 101 in each group. Specifically, for 45 
example, as shown in Fig. 248, the video images 01 to 
08 in the first group are respectively allocated to the 
divided parts D1 to D8 in one composite video frame 
and the video images 09 to 016 in the second group 
are respectively allocated to the divided parts D1 to D8 so 
of the next conposite video frame. Similarly, the proc* 
ess of generating the composite video frame is 
repeated as shown in Figs. 24D. 24E. .... In this case as 
well, at the time of reproduction, in a manner similar to 
the case of Fig. 23. it is sufficient to further reduce the ss 
reduced video image in each divided part, generate one 
conposite video frame from the 16 reduced video 
images, and display the conposite video frame on a 



screen. 

— [0100] Although 4he -embodiment of -the Jnvention — - — 

has been described ak>ove. the invention is not limited to 

the embodim ent but can be variously mod ified. For ■ 

exanpleT the invention is not limited to the case of corn" 
pressing a video signal and recording the compressed 
video signal but also can be applied to a case where the 
video signal is recorded without being compressed. The 
invention is not limited to the video recording apparatus 
for monitoring but can be applied to apparatuses of 
other uses such as recording apparatuses used for var- 
ious observations. 

[0101] Although the supplied video images are syn- 

thesized.by using the memory, as a work area and.the 

generated conposite video image is recorded together - 
with the additiortal data onto a video tape in the embod- 
iment, it is also possible to tenporarily record a supplied 
video image as it is on a disk-type recording medium 
such as a hard disK perform the video compositing 
process and the compressing process, and record a 
composite image obtained by the processes together - ^ 
with the additional information onto a video tape. 
[0102] Although the input video images in the :case_ -7 
of paying attention to each of the video cameras 1 01 are 
intermittent data with respect to time in the embodi- 
ment, the invention can be also applied to video images 
which are continuously inputted with respect to time. For 
exanple. as shown in Figs. 25A to 25E. video images 
from four video cameras 101 of Figs. 25A to 25D are 

simultaneously, parallelly recorded in a buffer rnemory. 

the reducing process is performed on the captured 
video images, and the synthesis is carried out. In such 
a manner, as shown in Fig. 25E. all of video images 
from the four video cameras 101 can be continuously 
displayed in a composite video frame. In this case, 
higher-precision monitoring recording without dropping 
images can be performed. ^ ~ - — 
[0103] Although the configuration in which only the 
recording of data onto the video cassette tape 7 is per- 
formed has been described In the embodiment, the 
recording and reproducing operations may be simulta- 
neously performed. In this case, by using a dual port 
RAM having two ports for input and output of data as the 
memory unit 5. the recording and reproducing opera- 
tions can be perfectiy simultaneously performed. Also In 

the case of using an ordinary RAM having only one port 
for input and output as the memory unit 5, for exanple. 
by performing the recording and reproducing operations 
in a time-division manner by using a time slot, at least 
apparentiy. the recording arxl reproducing operations 
can be simultaneously performed. 
[0104] Although the case where the video supply 
sources are the video cameras has been described in 
the emtxxJiment, the Invention Is not limited to the case. 
The video supply source may be a video reproducing 
apparatus capable of reproducing a video image which 
has been already recorded such as a video cassette 
player or a DVD (Digital Video Disk) device. 
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[0105] As descrtoe d ab ove, according to the video 

recording apparatus or video recording method of at 
least preferred ennbodiments of the invention, a plurality 
of-video-images-supplied-are-reduced-to-generate- 
reduced video innages and a composite video image is 
generated by compositing the generated reduced video 
images, additional information for each of the images 
supplied is generated, and the composrte video image 
and the additional information are recaded onto a pre- 
determined recording medium in such a manner that 
the correspondence between each of the reduced video 
images included in the composite video image and each 
additional information can be maintained. Conse- 
quently, recording video images from a plurality of video^ 
supply sources at high density allows, long-time record- 
ing, and the reduced video image can be recorded in 
association with the additional information. Therefore, 
the reduced video image associated with the recorded 
additional information can be specified in the composite 
.video imager and the.recorded.content can be.analyzed^ 
by effectively using the additional information. 
[0106] ' Especially, -according— to another video 
recording apparatus of at least preferred embodiments 
of the invention, the composite video image generating 
means performs a predetermined image conrpression 
on a video inrege obtained by combining the reduced 
video images and outputs the compressed video image 
as a composite image. Consequently, higher-density 

recording ca n be ralized. 

[0107] ~ According to stllFahother 'video"recordirTg" 
apparatus of at least preferred embodiments of the 
invention, the recording means records the composite 
video image and the additional infomiation to the same 
recording medium. Therefore, it is easy to deal the com- 
posite video image and the additional information at a 

lump after recordingr- " ' ^ 

[0108] According to still another video recording 
apparatus of at least preferred embodiments of the 
invention, by switching video images outputted from a 
plurality of video supply sources in the time division 
manner, video images supplied from the video supply 
sources are captured intermittently. Consequerrtly. 
longer-tune recording can be ralized while using the 
recording medium having a limited recording capacity. 
[0109] According to the centralized monitoring 
recording system of at least preferred errixxiiments of 
the inverrtion, each of a plurality of video images sup- 
plied from a plurality of video cameras is reduced to 
thereby generate a reduced video image. The gener- 
ated reduced video images are composited to generate 
a composite video image, and additional information is 
generated for each of the supplied video images. The 
composite video image and additional information are 
recorded on a predetermined recording medium in such 
a manner that the correspondence between each of the 
reduced video images included in the composite video 
image and each of the additional information can be 
maintained. Recording video images from the plurality 



of video cameras at high density allows, long-time 
recording arid the reduced video image can be recorded 
in association with the additional information. Therefore, 
the-video-images-to-be-nx)nitored-can-be-continuously 

5 recorded for long time without replacing the recording 
medium, and the recorded video image of each video 
camera can be analyzed in detail by effectively using 
the additional infornruition. For example, a desired 
reduced video image can be easily retrieved from 

10 recorded composite video images and the video cam- 
era can be easily specified by the additional information. 
[01 1 0] Obviously many modifications and variations 
of the present invention are possitsle in the ligfrt of the 
above teachings. It is therefore to be understood thaf 

15 within the scope of the apperxled claims the invention 
may be practiced otherwise than as specifically 
described. 

Claims 

1. A video recording apparatus comprising: 
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composite vidTO^iiroge'gen^T^ rTieahs~fdr" 
generating reduced video images by reducing 
each of a plurality of video images supplied and 
generating a composite video image by com- 
positing the generated reduced video images: 
additional information generating means for 
generating additional information for each of 
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thesupplied video irnages : arrcl ~ 
recording means for recording the composite 
video image and the additional information 
onto a predetermined recording medium in 
such a manner of maintaining the correspond- 
ence between -.each- of the reduced video 
^images included in- the composite video image 
and each additional information. 



2. The video recording apparatus according to daim 
40 1 , wherein the composite video image generating 

means performs a predetermined image compres- 
sion to a video image obtained by combining the 
reduced video images and outputs the compressed 
video image as the composite video image. 
45 ' ~ 

3. The video recording apparatus according to daim 
1, wherein the predetermined recording medium is 
a tape-shaped recording medium capable of 
recording digital video information. 

so 

4. The video recording apparatus according to daim 
1 , wherein the recording means records the com- 
posite video image and the additional Information 
onto the same recording medium. , 

55 

5. The video recording apparatus according to daim 
1, wherein the supplied video images are video 
images intermittently captured by switching the 
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7. 



video images outputted from video supply sources 
in a time division manner. _ „ „ 

The video recording apparatus according to claim_ 
1, wherein the additional information includes at 
least one of supply source information indicative of 
each of supply sources of the supplied video 
images, recording date and time information indica- 
tive of date and time on/at which each of the video 
images is recorded, frame division configuration 
information indicative of the arrangement and the 
maximum numkDer of reduced video images in the 
composite video innage, recording apparatus identi- 
fication Information for identifying the video record-- 
ing apparatus used- for recording; and contents 
information regarding the contents of each of the 
reduced video images included in the composite 
video image. 

The video recording apparatus according to claim 
1, wherein the supplied video images are video 
images outputted from a plurality of video cameras. 
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8. The yideo recording apparatus according to claim 

7, wherein the supplied video images are video 
images intermittently captured by switching the 
video images outputted from the video cameras in a 
time division manner. 

9. - The_video, recording apparatus_according_to_claim_ 

8, wherein the additional information includes at 
least one of camera identification information for 
identifying each of the video cameras, camera 
name information indicative of the name given to 
each of the video cameras, recording date and time 
information indicative of date and time on/at which 
each of the video images is recorded, frarrie divi- 
sion configuration information indicative of arrange- 
ment and the maximum numt>er of the reduced 
video images in the composite video image, the 
recording apparatus identification information for 
identifying the video recording apparatus used for 
recordjng and_contents information reg ardin g the 
contents of each of the reduced video images 
included in the composite video image. 

10. A centralized monitoring recording system compris- 
ing: 

a plurality of video cameras for capturing and 
outputting video images; 
composite video image generating means for 
generatir^ reduced video images by reducing 
each of a plurality of video images supplied 
from the video cameras and generating a com- 
posite video image by compositing the gener- 
ated reduced video images; 
additional information generating means for 
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generating additional information for each of 

Jhe.supplied video images; and . 

recording means for recording the composite 
video image arxJ the additional information 
onto a predetermined recording Iriedium in 
such a manner of maitaining the con-espond- 
ence between each of the reduced video 
images included in the composite video image 
arxl each additional information. 



11. A video recording method comprising: 

a step of generating reduced video images by 
reducing each of a plurality of video.images . 

supplied and generating a composite video 

image by compositing the generated reduced 
video images; 

a step of obtaining additional information for 
each of the supplied video images; and 
a step of recording the composite video image 
— -^ ^and the additional information onto a predeter- 
mined recording medium in such a manner of 
— maintaining the correspondence between each 
of the reduced video images included in the 
composite video image and each additional 
information. 

12. The video recording method according to daim 11. 
wherein the step of generating the composite video 
image includes a step of perforrning. a predeter^ 
mined image compression to a video image 
obtained by combining the reduced video images 
and outputting the compressed video image as the 
composite video image. 

13. The video recording method according to claim 11. 
"wherein a tape-shaped recording medium capable 
of recording digital video information is used as the 
predetermined recording medium. 

14. The video recording method according to daim 1 1 . 
wherein the composite video image and the addi- 

tional information are recorded onto the same 

recording medium in the recorcfing step. 



45 



15. The video recording method according to daim 11. 
wherein the additional information includes at least 
one of supply source information indicative of each 
of supply sources of the supplied video images. 

so recording date artd time information irKlicative of 
date and time on/at which each of the video images 
^ recorded, frame division configuration informa- 
tion indicative of the arrangement and the maxi- 
mum number of reduced video images in the 

55 composite video image, recording apparatus identi- 
fication information for identifying a video recording 
apparatus used for recording, and contents infor- 
mation regarding the contents of each of the 



14 

DCXIID: <EP 1030519A2_L> 



27 EP 1030 519 A2 

reduced video images included in^the composite 

video image. 



*^1 6rThe^ideo"recbTding"method"acc^^ 

wherein the supplied video images are video s 
images outputted from a plurality of video cameras. 

17. The video recording method according to claim 16. 
wherein the additional information includes at least 
one of camera identification information for identify- io 
ing each of the video cameras, camera name infor- 
mation indicative of the name given to each of the 
video cameras, recording date and time Inforrnation _ 
indicative of date and time on/at which each of the 
video images is recorded, frame division configura- is' 
tion information indicative of arrangement and the 
maximum number of the reduced video images in 
the connposite video image, tiie recording appara- 
tus identification information for identifying a video 
■-^ recording apparatus itself-used'for recording-and --20- 
contents information regarding the contents of each 
of the reduced video images includ ed-in-the -com — 
posite video image. _ . 
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